OpenWebText, Wikipedia dump, Gutenberg, BookCorpus, Alpaca (these are public datasets referenced in paper)

1 min